Optimal hypothesis testing for high dimensional covariance matrices
نویسندگان
چکیده
This paper considers testing a covariance matrix in the high dimensional setting where the dimension p can be comparable or much larger than the sample size n. The problem of testing the hypothesis H0 : = 0 for a given covariance matrix 0 is studied from a minimax point of view. We first characterize the boundary that separates the testable region from the non-testable region by the Frobenius norm when the ratio between the dimension p over the sample size n is bounded. A test based on a U -statistic is introduced and is shown to be rate optimal over this asymptotic regime. Furthermore, it is shown that the power of this test uniformly dominates that of the corrected likelihood ratio test (CLRT) over the entire asymptotic regime under which the CLRT is applicable. The power of the U -statistic based test is also analyzed when p/n is unbounded.
منابع مشابه
Estimating Structured High-Dimensional Covariance and Precision Matrices: Optimal Rates and Adaptive Estimation
This is an expository paper that reviews recent developments on optimal estimation of structured high-dimensional covariance and precision matrices. Minimax rates of convergence for estimating several classes of structured covariance and precision matrices, including bandable, Toeplitz, and sparse covariance matrices as well as sparse precision matrices, are given under the spectral norm loss. ...
متن کاملGlobal Testing and Large-Scale Multiple Testing for High-Dimensional Covariance Structures
Driven by a wide range of contemporary applications, statistical inference for covariance structures has been an active area of current research in high-dimensional statistics. This paper provides a selective survey of some recent developments in hypothesis testing for high-dimensional covariance structures, including global testing for the overall pattern of the covariance structures and simul...
متن کاملMinimax Estimation of Large Covariance Matrices under l1-Norm
Driven by a wide range of applications in high-dimensional data analysis, there has been significant recent interest in the estimation of large covariance matrices. In this paper, we consider optimal estimation of a covariance matrix as well as its inverse over several commonly used parameter spaces under the matrix l1 norm. Both minimax lower and upper bounds are derived. The lower bounds are ...
متن کاملCovariance Matrix Estimation in Time Series
Covariances play a fundamental role in the theory of time series and they are critical quantities that are needed in both spectral and time domain analysis. Estimation of covariance matrices is needed in the construction of confidence regions for unknown parameters, hypothesis testing, principal component analysis, prediction, discriminant analysis among others. In this paper we consider both l...
متن کاملInference for high-dimensional differential correlation matrices
Motivated by differential co-expression analysis in genomics, we consider in this paper estimation and testing of high-dimensional differential correlation matrices. An adaptive thresholding procedure is introduced and theoretical guarantees are given. Minimax rate of convergence is established and the proposed estimator is shown to be adaptively rate-optimal over collections of paired correlat...
متن کامل